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faxed to me new tasking with regard to providing support for the project 
evaluation. 1am asked to find “the 10 primary studies or reports developed under the 
subject program...that make the best case for establishing the validity of the paranormal 
phenomena known as Remote Viewing.” I am happy to do this as soon as possible. 


I have a concern, however, about a problem that may be raised that could call any results 
into question. 

Dr. Robert Rosenthal in the Psychology Department at Harvard and others have defined a 
statistical circumstance known as the “file drawer” problem. It is standard practice in 
behavioral sciences (including the study of anomalous cognition—remote viewing) to use 
a p=0.05 criteria as a measure of statistical significance. That is, statistical significance is 
claimed when, given that the null hypothesis (i.e. no RV in this case) is TRUE, there is a 
50% chance that a repeated experiment of the same number of trials would yield a 
statistical deviation as large as in the original, or larger. We use that criterion in our 
laboratory. 


The file draw problem is this: Under the null hypothesis 5% of the studies will be 
statistically significant. If only the significant studies are published (or in our case given 
to AIR), it is problematical to assess the validity of the research, because it might be that 
for every study published there are 19 others (in the file drawer) that did not reach 
statistical significance and were not published. Ifthis were the case, there would be no 
evidence for an anomaly. Rosenthal and others provide ways of assessing the potential 
magnitude of this problem. 

It might be argued that if 1 am allowed to pick the best 10 studies, and if it turns out that 
there were 200 others that were not “good,” one could be seriously mislead. This is a 
worst case scenario; however, critics would correctly argue that there is an undetermined 
file drawer problem with this new approach, and if it is not addressed, the validity of the 
evaluation can be questioned. I can assure you that Ray Hyman will raise this point. 
Might I suggest an alternative that address the concerns of the time con straint, yet avoids 
the file drawer problem. In 1989, SRI published (now downgraded to unclassified) a 
meta-analysis of all the SRI work from 1973 through 1989. This study was part of the 
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